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Abstract 

The transformation from high level task specification to low level motion control is a fundamental 
issue in sensorimotor control in animals and robots. This thesis develops a control scheme called 
virtual model control which addresses this issue. 

Virtual model control is a motion control language which uses simulations of imagined mechanical 
components to create forces, which are applied through joint torques, thereby creating the illusion 
that the components are connected to the robot. Due to the intuitive nature of this technique, 
designing a virtual model controller requires the same skills as designing the mechanism itself. A 
high level control system can be cascaded with the low level virtual model controller to modulate 
the parameters of the virtual mechanisms. Discrete commands from the high level controller would 
then result in fluid motion. 

An extension of Gardner's Partitioned Actuator Set Control method is developed. This method 
allows for the specification of constraints on the generalized forces which each serial path of a parallel 
mechanism can apply. 

Virtual model control has been applied to a bipedal walking robot. A simple algorithm utilizing 
a simple set of virtual components has successfully compelled the robot to walk eight consecutive 
steps. 
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{B} from reaction frame {A} with 

reference to frame {A} 
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{B} from reaction frame {A} with 

reference to frame {0} 
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Chapter 1 

Introduction 



Design and analysis of control systems for non-linear systems such as robots seems to be orders 
of magnitude more difficult than for linear systems. Despite these difficulties, researchers have 
developed several powerful techniques for controlling several classes of non-linear systems. For 
example, impedance control and adaptive controllers are two examples of powerful techniques for 
controlling robot arms. The former is well-suited for controlling contact impedances of the arm as 
seen by the environment. The latter is well suited for doing trajectory following while adapting to 
robot parameters. 

A class of robots which suffers from lack of powerful techniques for its control is dynamic legged 
locomoting robots. These robots are extremely difficult to control since they 

• Are nonlinear and operate throughout the range of their state space 

• Act in a gravity field 

• Interact with a semi-structured, complex environment 

• Are nominally unstable 

• Are Multi Input, Multi Output (MIMO) 

• Exhibit time variant dynamics with zeroeth and first order discontinuities as support modes 
are transitioned (e.g. single support, double support, ballistic phase, etc.) 

• Require both continuous control and discrete control (for step-to-step transitions) 

In addition, the performance measures of such robots are much different than typical notions of 
performance such as command following and disturbance rejection. Performance for these robots is 
usually defined in some of the following terms: 

• Biological similarity 

• Efficiency, i.e. Distance traveled per unit energy input 

• Locomotion smoothness 

• Top speed 

• Robustness to rough terrain 

Because of these difficulties, the only acceptable tools for analyzing such systems is simulation 
or experimentation and the only good design tools are often physical intuition, parameter iteration, 
and "hand tweaking" . 

Despite these difficulties, robots have been developed at MIT's Leg Laboratory which can hop, 
run, and perform gymnastic maneuvers [25]. The control algorithms employed are very simple and 




draw on physical intuition. Other factors contributing to the success of the robots include excellent 
design and construction, conservative over-actuation, and a bit of luck. However, it is difficult, if not 
impossible, to perform an acceptable mathematical analysis of why the control algorithms employed 
on these robots are successful in making them run. 

If one wishes to expand the toolbox of analysis and design techniques for such a class of robots, 
he or she must either make a quantum leap in control system design and analysis mathematics, or 
else exploit physical intuition. In this thesis we present a control technique, dubbed virtual model 
control, which attempts the latter. 

1.1 Virtual Model Controllers 

Virtual model control is a language for describing interactive force behaviors. This control technique 
uses simulations of virtual mechanical components to generate actuator torques (or forces) thereby 
creating the illusion that the simulated components are connected to the real robot. Because any 
imaginable component can be used, virtual model control requires no loss of generality and traditional 
control techniques can be utilized in the same context. For example, a proportional-derivative (PD) 
servo at a joint can be implemented as a virtual torsional spring-damper with spring constant equal 
to servo position gain, damping constant equal to derivative gain, and set point equal to desired 
joint angle. Virtual components can even contain adaptive and learning elements [22]. 

One of the reasons virtual model control is being developed is because it is generally difficult 
to describe motion control. For example, how would one describe what he or she is doing when 
performing deep knee bends and how would one control a robot to perform this task? A quick and 
easy method would be to attach a virtual spring between the robot's feet and its waist and change 
the rest-length in a sinusoidal fashion. 

Another complex task which is difficult to describe using traditional control methodologies is the 
throwing of a punch by a robotic boxer. A simple virtual model controller might consist of a virtual 
force source connected between the robot's chest (to throw a jab) and the end of its hand, producing 
a virtual force in the direction of the opponent. Virtual components could be connected between 
the feet and the body to help maintain balance (see Figure 1-1). If the robot wanted to throw a 
knock-out upper-cut, using everything it has, virtual actuators could be attached to its hand from 
its feet, hip, and chest. Whereas the jab controller would only cause chest and arm torques to be 
exerted, the upper-cut controller would use every available joint torque in the robot's body. 

Some benefits of virtual model control are that it is compact, requires a relatively small amount 
of computation, and can be implemented in a distributed manner. These benefits are due to the 
fact that no matrix or function inverses need be computed for serial links; all equations can be 
precomputed in closed form and optimized; and multiple virtual components can be independently 
computed and superposed since their outputs, joint torques, are linearly additive. 

Furthermore, a high level controller could be implemented as a state machine which simply 
changes virtual component connections or parameters at the state transitions. Even though a discrete 
high level controller would be used, the overall motion would be fluid as the virtual components would 
be continuous. 

Like any new idea, virtual model control draws from several techniques that are currently used in 
practice. The following list contains six of these techniques and describes how virtual model control 
compares and contrasts. 

• Virtual Reality / Haptic Interfaces [28]. Virtual Reality is a means of creating the illusion 
of virtual entities existing in a simulated environment. Haptic Interfaces are devices which 
provide tactile and force feedback for Virtual Reality applications. Virtual model control is 
similar to Virtual Reality and Haptic Interfaces in that it is used to emulate imaginary entities. 
It is different in that it emulates components which are connected to a robot in attempt to 
persuade the robot to perform a certain task, rather than to create an illusion to a human 
operator. 

• Hybrid Position/Force Control [24]. Hybrid Position/Force Control is a method for com- 
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Figure 1-1: Robotic Boxer with virtual components attached from the feet to the body to maintain 
balance and from the body to the hand to throw a jab. 



manding positions in an unconstrained cartesian subspace while commanding forces in the 
orthogonal subspace. Virtual model control is similar to hybrid position/force control in that 
both desired positions and forces can be controlled. However, with virtual model control the 
space in which positions are controlled need not be orthogonal to the space in which forces are 
controlled. In virtual model terms, a PD position controller is equivalent to a spring-damper 
mechanism. There is no reason why a real spring-damper could not be attached in parallel 
with a real force source, so there is no reason why both virtual components cannot be attached 
to a robot and act in non-orthogonal spaces. 

• Stiffness Control [26]. Stiffness Control is a method for controlling a robot so that its endpoint 
cartesian stiffness matches a given stiffness matrix. Virtual model control can be used to 
implement Stiffness Control if linear virtual springs are used and connected to the robot in 
the necessary manner. 

• Impedance Control [13]. Impedance control is a method for controlling a robot so that its 
impedance, as seen by the environment, matches a target impedance. In contrast, virtual 
model control is used to simulate components, which can be modelled as impedances, between 
two points on the robot. These two points can be attached anywhere on the robot, not just on 
the base and end effector. 

• Operational Space Formulation [15] . The Operational Space Formulation is a framework for the 
analysis and control of manipulator systems with respect to the dynamic behavior of the end 
effector. Virtual model control is similar to Operational Space Formulation in that coordinate 
transformations are used in order to create a more intuitive space in which control is defined. 
However, the virtual model coordinate systems can be attached to any part of the robot, not 
just the end effector. 

• Coordinated Jacobian Transpose Control [31], [2]. Coordinated Jacobian Transpose Control is 
an algorithm for coordinated position and force control for autonomous multi-limbed mobile 
robotic systems. Generalized control variables are defined with respect to a single inertial frame 
and controlled to a commanded position via a set of linear springs and dampers. Virtual model 
control allows for the use of multiple non-inertial frames for connecting components which 
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aren't limited to springs and dampers. Also virtual model control allows for the specification of 
constraints (such as limp joints) and provides a framework for controlling parallel mechanisms. 

Virtual model control is inspired by, and is a superset of the above control techniques. We stress 
the following major points, 

• Virtual model control is an intuitive language for describing complex motion control tasks. 

• Virtual model control allows for the use of generalized variables and generalized force functions. 

• Virtual model control can be implemented on any serial link or set of serial links on the robot 
and not just between a base and end effector. 

• Virtual model control can be implemented on serial or parallel, redundant or underactuated, 
fixed or free-flying robotic systems. 

• Virtual model control allows one to specify mechanical constraints, such as unactuated joints, 
or design constraints, such as force equalization. 

• Adaptive and learning techniques can be implemented with virtual models, thereby creating 
adaptive or learning virtual components. 

Note that some of the above mentioned control techniques, along with other control schemes, 
use dynamical inversion in attempt to alter the behavior of the robot. We like to call this technique 
the "Virtual Robot" approach. Virtual model control can be used to simulate a virtual robot by 
adding virtual forces to counter gravity and virtual mass (negative or positive) at the center of mass 
of each link. However, this is not the intended application of virtual model control. We believe the 
following, 

The virtual robot approach (plant inversion) should only be used when high performance 
requirements or other extreme situations dictate. This is because, 

1. Plant inversion adds computational complexity. 

2. Fighting the natural dynamics of the robot can be inefficient. 

3. Undesirable natural dynamics is an indication that the real robot was designed 
improperly. 

4. Overcompensation can lead to instability. 

Also note that with virtual model control, we usually talk in terms of spring set points, for exam- 
ple, and not commanded positions. Except for actuator non-idealities, we can perfectly implement 
virtual components whereas very few control algorithms can perfectly track a commanded trajectory. 
In this light we believe, 

Robots cannot be commanded to perform a task; they can only be given hints and 
suggestions. 

1.2 Summary of Thesis Contents 

This thesis is organized as follows: 

Chapter 2 describes the notation and mathematics for implementing virtual models. 

Chapter 3 explains several examples of virtual model formulation for various robot models. 

Chapter 4 presents a simple example of when local control techniques, such as inverse kinematic 
control, fails but virtual model control succeeds. 
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Chapter 5 demonstrates, using Lyapunov analysis, that a passive robot with any number of passive 
virtual component connected to it will remain passive. 

Chapter 6 describes how non-ideal actuators may affect virtual model control and proposes the 
relevant issues which must be addressed. 

Chapter 7 defines the stability and performance requirement of virtual model controllers. 

Chapter 8 analyzes a simple single input, single output (SISO), linear time-invariant (LTI) example 
of a virtual model controller being implemented with a non-ideal actuator. 

Chapter 9 describes the application of virtual model controllers to bipedal dynamic walking. 

Virtual model control is currently being used to control a dynamic walking bipedal robot, as 
described in Chapter 9. We have found that the robot can walk a number of steps using only a 
simple set of virtual components. Future work will focus on using virtual model control to produce 
more robust and efficient walking. 
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Chapter 2 

Virtual Model Implementation 



The implementation of virtual components is fairly simple. There are five major steps: definition of 
the virtual model reference frames; computation of the forward kinematics; calculation of a Jacobian 
matrix, computation of the joint torques; and definition of the virtual model force function. 

Since forward kinematics of serial links produces closed form solutions for any robot with pris- 
matic and revolute joints and since differentiation of closed form functions produces closed form 
functions, all the necessary equations will be relatively easy to derive and efficient to compute. 
For parallel virtual components, one must divide the generalized force amongst the individual se- 
rial paths. This requires solving a system of equations (i.e. inverting a matrix). Subsection 2.6.1 
describes an extenstion of Gardner's Partitioned Actuator Set Control Technique method which 
minimizes the necessary computational requirements. 

The derivation can all be done off-line and future work will focus on automating this process. 

2.1 Definition of the Virtual Model Frames 

Each virtual component requires three coordinate frames. These are denoted as 

• Action Frame {B} 

• Reaction Frame {A} 

• Reference Frame {0} 

where the frame symbols corresponds to those of Figure 2-1. The action frame defines the virtual 
component connection upon which the generalized forces act. The reaction frame defines the second 
attachment point of the virtual component. The reference frame is the coordinate system in which 
all displacements, forces, etc are expressed. 

Choosing the right reaction frame is very important. In most treatments of similar control 
methods, the reaction frame is assumed to be fixed to ground and usually is not even mentioned. 
However, one must remember Newton's Third Law. One cannot simply describe a force acting at a 
point. One must describe forces acting between two points. Similarly, in the virtual model context, 
one cannot simply define a generalized force acting on a frame but must define a generalized force 
acting between two frames. 

The action, reaction, and reference frames need not be inertial, nor cartesian, and none need to 
be directly attached to parts of the physical robot. All three frames simply need to be well defined. 
In most cases, however, all three frames will be cartesian, they will be connected to logical points 
on the robot such as joints, links, or end effectors, and reference frame {0} will either be inertial or 
coincide with {A} or {B}. In other words they will be connected where they make the most intuitive 
sense. 

In our use of the reference frame, {O}, we are not concerned about its location and in fact it 
need not be specified. All that is needed is the relative rotation between the reference frame and 
the action and reaction frames. 
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Figure 2-1: Virtual Component Reference Frames. {B} is the action frame. {A} is the reaction 
frame. {0} is the reference frame. VC represents the virtual component. The virtual component is 
drawn schematically to show it acts between frames {A} and {B}. The forces exerted by the virtual 
component can be in any admissible direction. 



Choice of the virtual model frames is a major part of defining a virtual component and must be 
done carefully if the desired results are to be obtained. For example, both the action and reaction 
frames may be defined so that there is no relative rotation between them in any orientation of the 
robot. This is perfectly valid but it then makes it impossible to produce a relative torque between 
the two. The best tools for determining how to attach the virtual component's frames is physical 
intuition, insight, and experience, i.e. the same tools required to design the robot mechanism itself. 

2.2 Derivation of the Forward Kinematics 

Computing the forward kinematic map, gX, is relatively easy and well documented [7]. For any 
serial manipulator with revolute and prismatic joints, gX will be a closed form function of the joint 
angles and prismatic displacements, 0, lying between frames {A} and {B}. The robot link length 
parameters will enter this function as constant coefficients if frames {A} and {B} are rigidly attached 
to the links of the robot. This is not true in general, however. 

To express the kinematics between frames {A} and {B} with reference to frame {0}, we use the 
rotation matrix between {0} and {A} 



O/A 



(U) 



On Ay 



(2.1) 



Note that we ignore the displacement between {0} and {A}. This is because we are concerned with 
the relative kinematics between the reaction and action frames and not the absolute location of any 
of the frames, with reference to {0} or World Coordinates. 

All virtual components do not necessarily need to provide actuation. They can be used with the 
forward kinematics alone and act simply as virtual sensors. 

2.3 Derivation of the Jacobian Matrix 



Let the Jacobian Matrix for a virtual component be defined in the following manner 

d 



A J 



dO 



X 



(2.2) 
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The Jacobian will be in closed form if B X is in closed form. For the 2D case, the Jacobian can 
easily be computed by partial differentiation of the forward kinematic map. If the link parameters 
enter the forward kinematics as constant coefficients, then they'll also be constant coefficients in the 
Jacobian. 

The Jacobian can be used for several things. It can be used to calculate generalized velocities by 

iX=i,ie (2.3) 

which holds by definition. To express velocities with respect to the reference frame, we again use 
the rotation matrix, 

°(iX)=°RiX (2.4) 

The Jacobian is also used to transform generalized forces to joint torques as discussed next. 

There are several techniques to compute the Jacobian for the 3D case [19, 7]. One method 
described in [7] is to recursively compute the joint to cartesian velocity relationship (Equation 2.3) 
and extract the Jacobian Matrix. 

2.4 Computation of the Joint Torques 

To compute the joint torques which will successfully emulate the virtual component, we use the 
following equation 

r=p T iF (2.5) 

where f is the vector of joint torques (or forces for prismatic joints) and B F is the generalized force 
vector acting on action frame {B} from reaction frame {A} defined with respect to frame {A}. The 
generalized force vector will typically consist of a force and moment vector. 

Equation 2.5 can be easily derived starting from the energy balance t 1 bQ = F T SX [7]. It 
requires that the generalized forces which act on action frame {B} be specified in terms of reaction 
frame {A}. If the forces are expressed in reference frame {O}, we must use the rotation matrix from 
{A} to {0} to express them in {A}, 

\ B F) (2.6) 
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°(P) T °( B F) (2.7) 

One point of note is that "admissible" generalized forces lie in the row space of °( B J) T ■ By 
admissible, we mean forces which can be realized using the available joint actuators. For example, 
if no relative motion can be realized along a certain direction, then no matter how large a force is 
produced along that direction in real life, no effect will result on the robot (assuming rigid links). 
Similarly, any generalized forces which lie in the null space of ( B J) T will produce no torque at 
the joints and hence have no effect on the robot. Whether or not such an inadmissible generalized 
force should be allowed probably depends on the implementation. In any case, an inadmissible force 
should be detectable. An easy test is to see if it lies in the row space of the Jacobian transpose. When 
implementing parallel virtual components, as in Section 2.6, it is important that the inadmissible 
force constraints be known for each of the serial paths of the virtual component so that the desired 
generalized force can be accurately divided amongst the individual serial paths. 

2.5 Definition of the Generalized Forces 

The final part of defining a virtual component is to find a relation between the relative displacement 
and rotations of the action and reaction frames and the generalized forces to be applied to the action 
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frame. In other words, we need to choose a generalized force function 



O/A 



(^)=^f( u (^),v1) 



(2.8) 



where B F is the generalized forces acting on action frame {B} from reaction frame {A}, B X is 
the generalized displacement of frame {B} from frame {A} computed in section 2.2, v are other 
parameters and variables, and s is the state of dynamic simulated virtual entities such as masses 
and inertias. The superscripts denote that all measurements are defined with respect to reference 
frame {0}. If virtual components which have state are used, then one must implement a real-time 
dynamic simulation to update the component's state. 

As an example, to implement a generalized spring-damper mechanism, one could use 



O/A 



O/A 



^F) = k("( B X))-b("( B X)) 



(2.9) 



where °( B X) is the error between the spring set-point and the actual position and k and b are the 
spring and damper functions. 

Of course, the virtual component need not be just a spring or damper; any component which 
can be expressed in terms of Equation 2.8 is valid. The simulated mechanism need not be linear, 
monotonic, nor even physically realizable. In fact, one could simply treat the virtual component as 
a virtual actuator and produce the virtual forces by any desired control method. 

2.6 Parallel Mechanisms and Multi-Frame Virtual Compo- 
nents 

Up to this point we have only dealt with serial link manipulators. With a serial link structure all 
the necessary equations are relatively simple to derive. With a parallel structure a matrix inversion 
is necessary. 

We start by defining one action frame {B}, one reference frame {0} and multiple reaction frames 
{Ai} as in Figure 2-2. Frame {A*} is a construct used to represent all of the frames {A} and can 
be viewed as the conglomerate reaction frame. The parallel virtual component structure can be 
considered as multiple serial structures acting on the same action frame. Each serial sub-component 
has a corresponding Jacobian which is calculated as in Section 2.3. We combine these to get 



(2.10) 



We now have a mapping from sub-component generalized forces to joint torques. However, 
we wish to specify a single generalized force to act on the action frame. Since the action frame 
and reference frame are coincidental for all the sub-components, the vector sum of the individual 
generalized forces must equal the desired generalized force, 
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(2.11) 



We need to solve for ( B F) in terms of (;g F). To do this we must add a number of constraints. 
Some of these constraints will arise due to the inadmissibility of certain individual force directions. 
These constraints can be determined by examining the row space of the individual \ B J) ■ Others 
will arise from constraints on the robot such as unactuated joints. The rest of the constraints can 
be used as design degrees of freedom. 

Once enough constraints have been determined, we will have a square invertible constraint matrix, 
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Figure 2-2: Parallel Virtual Component Reference Frames. Frame {B} is the action frame. Frames 
{Ai} are the reaction frames. Frame {0} is the reference frame. VC represents the conglomerate 
virtual component which is comprised of the individual virtual components VC\. Frame {A*} is an 
imaginary construct which represents the reaction frame of the conglomerate virtual component. 
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K, so that the constraints can be written in the form 



°(i'F) 



K 



and the individual sub-force vectors resolved as, 
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(2.12) 
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(2.13) 



where the elements of 



°( A b v F) 

be extra control variables, such as individual interaction forces, or 
for constraints which are solely a function of the forces °{ B 'F). Of course, we need not retain the 
columns of K~ l which are multiplied by 0. We can now substitute Equation 2.13 into 2.10 to get 
the final force to torque relationship. 



2.6.1 Inverting the Constraint Matrix 

Equation 2.13 requires inverting a potentially large sparse matrix. We show here a method for 
taking advantage of the structure of the constraint matrix, K, in order to reduce computational 
requirements. The method is an extension of Gardners's Partitioned Actuator Set Control Technique 

[11, 10]. 

Gardner partitions the actuators into a Minimum Actuator Set (MAS) and a Redundant Actuator 
Set (RAS). We stress here that we are not dealing with actuators at this level but rather virtual 
force distribution. Therefore we specify the Minimum Force Set (MFS) and the Redundant Force 
Set (RFS). We extend Gardner's method by adding the Constrained Force Set (CFS) for dealing 
with natural constraints, such as underactuated legs, point feet, and limp joints. 

We assume that all the serial paths of the parallel virtual components are of the same structure, 
with the same number of constraints. We do this only to simplify the following explanation. The 
mathematics is easily extended to the general case. 
We define the following constants, 
n dimension of the generalized force to be applied 

p number of serial paths of the parallel virtual component 

1 number of constraints in each serial path 

d = n-1 number of non-constrained degrees of freedom per serial path 

r = pd - n number of redundant serial path virtual force components 

The number of force elements in the Minimum Force Set will be n; in the Constrained Actuator 
Set / per serial path (pi total); in the Redundant Force Set r. How the forces are partitioned into 
these sets depends on the design constraints one wishes to implement and the limitations placed 
on these constraints by the extended partitioned force set method. These limitations are explained 
below. 

As an example, suppose we have a 100 leg millipede with 2 joints per leg and point feet. We 
would have n = 6 for the 3 elements of the force vector and 3 elements of the moment vector which 
we wish to exert; p = 100 for the 100 legs; / = 4 for the 3 constraints of no torques at the feet and 
the 1 constraint provided by the underactuation of having only 2 joints per leg; d = 2 meaning each 
leg can provide a 2 dimensional force vector from the 6 dimensional space; and r = 194 meaning we 



22 



have 194 redundancies and therefore can specify up to 194 design constraints. The Minimum Force 
Set would contain 6 elements; the Constrained Force Set 400; and the Redundant Force Set 194. 

We first partition the virtual forces into the Constrained Force Set (CFS), f lb , and those not in 
the CFS, f la , and rearrange Equation 2.12 into the following form, 
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(2.14) 



where I is the identity matrix, is the zero matrix, J la , J lb are natural constraint matrices, and 
D la , D lb are design constraint matrices. The Constrained Force Set consists of the forces f lb while 
the forces f' a belong in the Minimum and Redundant Force Sets. The subscript on each matrix 
block show the size of the block. Equation 2.12 can always be written in the form of Equation 2.14 
since the natural constraints for a given serial path will only be a function of the virtual forces on 
that path. 

We can reduce the size of the matrix in equation 2.14 by taking advantage of the sparseness of 
the natural constraint blocks. Each natural constraint row can be written as 

r\ jia ria _,_ jib rib 

Solving for / we have, 

f b = -(J ib )- 1 J ia f a (2.15) 

We can substitute this back into Equation 2.14 to get a reduced set of equations, 
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(2-16) 
We have now reduced the matrix size from np x np to dp x dp by eliminating the Constrained 
Force Set (CFS). Note that Equation 2.16 is still in the general form, i.e. we have put no restrictions 
on the design constraint equations. We could stop here and invert the new dp x dp matrix, if it were 
computationally feasible. In order to further reduce the size of the matrix, we can eliminate the 
Redundant Force Set (RFS) by specifying our design constraints in a proper manner. 

Similar to [11], we specify the Redundant Force Set, f , in terms of the Minimum Force Set, f m . 



fl 



b T xJ: 



(2.17) 



where f is the Redundant Force Set, f m is the Minimum Force Set, c is a vector of variables or 
constants, and B is the design constrain matrix. 

Writing the design constraints in terms of Equation 2.17 requires that 
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and D la are restricted so that we can rearrange Equation 2.16 into the following form, 



L 



B 
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(2.18) 



We can now eliminate the RFS, f, from Equation 2.18 to by substituting Equation 2.17 into 
2.18 to get 



[f-A r c] n = [A m -A r B} nXn [f™] 



(2.19) 



To solve for the MFS, f m , we must invert the n x n matrix in Equation 2.19. The Redundant 
Force Set is then computed by plugging back into equation 2.17. Finally, we can rearrange the 
Minimum and Redundant Force Sets to get f' a and substitute back into Equation 2.15 to solve for 
the Constrained Force Set. 

We now describe how one partitions the virtual forces into the three sets. In order to use the 
above method, one must write all the design constraints in the form of Equation 2.17. In writing 
these constraints, one must specify the Redundant Force Set and the Minimum Force Set. The 
remaining forces are the Constrained Force Set. One must make sure that the choice of design 
constraints allows for a solution of Equation 2.19 to exist. 

Examining Equations 2.16 to 2.19 we see that we take p [I x /], and 1 [n x n] matrix inversions in 
solving for the virtual forces applied to each serial path. These inversions will take significantly less 
computational resources to perform than the original np x np inversion. Since the computational 
complexity of matrix inversion scales with the cube of the matrix size, the above method is 0(pl 3 +n 3 ) 
whereas inverting the original matrix is 0(p 3 n 3 ). 



2.6.2 Pseudo-Inversion of the Constraint Matrix 

The above discussion assumed that we specified r design constraints. In some cases, we may not 
wish to specify as many design constraints, and we may not wish to be limited to specifying all the 
constraints in terms of Equation 2.18. Suppose we wish to specify only s design constraints, where 
s < r. If we specify the design constraints in the form, 



jr2 =c _ B ljm _ B 2jrl 

then instead of Equation 2.18, we will have, 
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(2.20) 



(2.21) 



Utilizing the structure of this matrix, we get the following set of Equations, 

l n 

iX(r-s) J , rl 



f n ] = [ [A m - A r2 B 1 ] nXn [A rl - A r2 B 2 



(2.22) 



The above matrix is non-square. To solve the above equation for f m and f rl , we can use the 
Moore- Penrose pseudo-inverse, 

A+ = A T (AA T )~ l (2.23) 

and then solve for f r2 by substituting back into Equation 2.20. 

The pseudo-inverse still requires inverting an n x n matrix so our computational requirements 
are about the same as the previous method. 
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2.7 Summary 

The implementation of a virtual component is relatively straightforward. The math may become 
cumbersome but equation derivation need be done only once for a given mechanism. For a serial 
mechanism, computational requirements are low as no functional or matrix inversions are required. 
For a parallel mechanism, a matrix inversion is necessary. However, by taking advantage of the form 
of the constraint matrix and by specifying the design constraints in the correct manner, the size of 
the matrices which need to be inverted are reduced. 

The most important part of creating a virtual component is that the virtual components be 
defined properly via the three frames and the generalized force function. This can be accomplished 
by using the same physical intuition and mechanism design approach used in constructing the robot. 
Therefore, virtual model control is as suited for someone who is comfortable with robot design as 
someone who is comfortable with control systems theory. 
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Chapter 3 

Examples 



In this Chapter we present several robot examples in which virtual models are used. We do not 
discuss the virtual components which are used but rather derive and discuss the relevant mathematics 
for each of the examples. These examples will be used in later chapters at which point actual virtual 
components will be used to do something interesting. For instance the foot example mathematics 
is derived in Section 3.3 and used in Chapter 4 as a simple example in which virtual model control 
works but blind application of inverse kinematics control fails. 

3.1 Single Leg Example 

Figure 3-1 shows a simple 2-D, four link, three joint, serial robot model which we use to represent a 
single leg of our walking robot (See Chapter 9). We wish to connect a virtual component between 
frame {A}, which is attached to the foot, and frame {B}, which is attached to the body. The angles 
9 a , 9k, and 9^ are those of the ankle, knee, and hip. The lower link (tibia) is of length L\, while the 
upper link (femur) is of length L 2 . In this example we assume that the foot is flat on the ground, 
so that °R= I. 

The forward kinematic map from frame {A} to frame {B} of this example is as follows, 

x ~\ T -Li sin(0 a ) - L 2 sm(9 a + 9 k ) 
\X= z = L x cos(# a ) + L 2 cos(9 a + 9 k ) (3.1) 

—9h — 9k — 9 a 



Partial differentiation produces the Jacobian, 

— L\ cos(# a ) — L 2 cos( 
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L 2 sin( 
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-1 



The Jacobian relates the virtual velocity between frames A and B, 



A 



4,je 



(3.2) 



(3.3) 



and the virtual force to joint torque, 



(PY ( a b f) 



(3.4) 



The Jacobian is of full rank, indicating that all virtual force directions are admissible. This is the 
typical setup for using the Jacobian to transfer from endpoint forces to joint torques. To keep things 
interesting, we add the constraint that r a = 0. An unactuated ankle will constrain the direction in 
which virtual forces can be applied. This constraint is equivalent to having a point foot since this 

n_ 
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Figure 3-1: Single Leg example. Reaction frame {A} is assumed to be in the same orientation as 
reference frame {0} so that ®R=I. 



example is 2-D. With a limp ankle, Equation 3.4 is constrained, 
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For our walking robot we are more concerned about applying forces in the vertical direction and 
torques about the body then we are concerned about applying horizontal forces. Therefore, we 
specify f z and fg and solve for f x 
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Plugging this back into 3.5, we get 
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(3.6) 



(3.7) 



We now have a simple set of equations for determining joint torques given virtual forces. Note 
that the matrix in Equation 3.7 is of full rank for all values of except for 9 k = 0. This corresponds 
to a fully extended knee, during which no virtual forces can be applied in the z direction. If the 
knee is not fully extended, all virtual forces are admissible. Also note that the denominator in 
Equation 3.7, L\ cos(9 a ) + L 2 cos(9 a + 9 k ), is gZ and hence is already computed in the forward 
kinematics. Throughout this example we have assumed that the feet are flat on the ground and that 
we can measure all angles. In actuality, we use point feet and measure the body angle via a boom 
or gyroscope, rather than the ankle. Therefore, we must make the substitution 
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Figure 3-2: Dual Leg example. Reaction frames {A} and {C} are assumed to be in the same 
orientation as reference frame {0} so that ^ R =a R = I- 



These equations will be used in Chapter 9 in the control of a bipedal walking robot during single 
support phase. 

3.2 Dual Leg Example 

The previous example discussed a serial chain manipulator. Here we examine a parallel mechanism 
representing a simple, 2-D, bipedal robot (See Figure 3-2). As discussed in Chapter 2, we can 
attach single-frame virtual components across any serial link or we can create a multi-frame virtual 
component with a common action frame. We describe the latter here. 

Our model consists of the previous single leg example plus another leg. We wish to connect a 
multi-frame virtual component between the reaction frames {A;} and {A r } which are connected to 
the feet, and the action frame {B} which is connected to the body. The individual leg parameters 
and joint angles are identical to those of the single leg example with the / subscript denoting the 
left leg and the r subscript denoting the right leg. Again, we assume that the feet are flat on the 
ground so that ^ R =a R= I- 

We already have the kinematics for each leg from the previous example. To calculate the body 
kinematics, we choose to use the average of these, 
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One could also choose the minimum, maximum, etc. or simply keep them separate. 

We have computed the Jacobian for each serial link of this parallel mechanism in the previous 
example. We now combine them in the following manner, 
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where 



(3.8) 



(3.9) 



A = -Li cos(9, a ) - L 2 cos(9 la + 0\k) 

B = -L x sin(6> ;a ) - L 2 sin(0, a + 0,fc) 
C = -Li cos(9 ra ) - L 2 cos(9 ra + 9 rk ) 
D = -Li sin(6> ra ) - L 2 sin(6> ra + 9 rk ) 

Q = -L 2 cos(9 la +9 lk ) 

R = -L 2 sm(9 la + 9 lk ) 

S = -L 2 cos(9 ra + 9 rk ) 

T = -L 2 sm(9 ra + 9 rk ) 

Equation 3.9 maps the virtual forces from each leg to the required joint torques, whereas we wish 
to specify a single virtual force. We therefore need to solve the individual leg forces in terms of the 
combined virtual force subject to several constraints. 

Since the action frame {B} is coincidental, we have the compatibility relation that the force 
vector must equal the vector sum of the forces produced by each serial chain, 



(3.10) 



Since we have six joints and wish to control three force directions, we require three constraints. 
Unactuated ankles provide two constraints, 
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The third constraint provides us with a design degree of freedom. We could choose it to maximize 
some performance criterion, etc. Here we simply choose to match the hip torques, 
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(3.13) 
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Putting the above constraints in vector form we have, 
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(3.14) 



We must now perform a 6 by 6 matrix inversion to solve for the individual leg forces. We drop 
the terms which are multiplied by zero. The result is a 6 by 3 matrix relating the single vector of 
virtual forces to the individual leg virtual forces, 
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where 
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Plugging Equation 3.15 into Equation 3.9 and simplifying, we get the virtual force to joint torque 
relation 



(3.17) 



where 

V = QB - RA = -L x L 2 sin(0,jfe) 

W = SD-TC = -L x L 2 sin(6W) 

Once again, we have a simple set of equations for relating virtual forces to joint torques. In- 
tuitively, the matrix in Equation 3.17 should be of full rank for all except when a knee is fully 
extended or the two feet and hip are colinear. In all other configurations, all virtual forces are 
admissible. Again, we will use point feet and measure the body angle via a boom or gyroscope, 
rather than the ankle angles. Therefore, we must make the substitutions 
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These equations will be used in Chapter 9 in the control of a bipedal walking robot during double 
support phase. 
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Figure 3-3: Foot example. 9 t is the toe angle, 9 a is the ankle angle, 9j is the angle of the foot with 
respect to frame {0}, and 61, is the angle of the body with respect to frame {0}. 



3.3 Foot Example 

Figure 3-3 shows a simple 2-D, three link, two joint, serial robot model which represents a foot. 
Unlike the previous examples, we do not assume that the last link is flat on the ground. We wish to 
reference all vectors to inertial frame {0}. 

The kinematics between frames {A} and {B} are easily calculated 



J 



-L 2 cos(9 t + 9 a) - L± cos(9 t ) 
-L 2 sm(9 t + 9 a) - L x sin(6» t ) 
Partial differentiation produces the Jacobian, 

L 2 sin(0i + 9 a) + L x sin(6» t ) L 2 sin(6» t + 9 a ) 
-L 2 cos(9 t + 9 a ) - L x cos(0i) -L 2 cos(9 t + 9 a ) 
We use the rotation matrix between frames {0} and {A} to transform the kinematics, 

cos(6» / ) sin^/) 

- sin (^/) co^ 6 */) 
-L 2 cos(9 f -9 a - 9 t ) - L x cos(9 f - 9 t ) 
L 2 sm(9 f -9 a - 9 t ) + L x sm(9 f - 9 t ) 
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°( A B X) = ° A R A B JQ 

-L 2 sm(9 f -9 a - 9 t ) - L x sm(9 f - 9 t ) -L 2 sm(9 f - 9 a - 9 t ) 

-L 2 cos(9 f -9 a - 9 t ) - L x cos(9 f - 9 t ) -L 2 cos(9 f - 9 a - 9 t ) 
We use the rotation matrix between frames {A} and {0} to transform the virtual forces 

cos^;) -sin^;) 
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The determinant of the matrix in Equation 3.24 is LiL 2 sm(9 a ). Therefore, all forces will be 
admissible until the ankle joint is fully extended, which makes intuitive sense. Since the body 
angle, rather than the foot angle, will be measured via a boom or a gyroscope we need to make the 
substitution 

9f = 9t, + 9 t + 9 a 

This simple example will be used in Chapter 4 as a case when inverse kinematics fails while virtual 
models succeed. 
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3.4 3D Hexapod Example 

The previous examples have all been two dimensional. This section presents a three dimensional 
example of a hexapod robot alternately being supported by a tripod composed of three of its six 
legs. Using three legs for support allows the hexapod to be statically stable and is a typical snapshot 
of the tripod walking gait. 

In the two dimensional examples, the Jacobians were computed by differentiation of the kine- 
matics. In contrast, the Jacobian for this three dimensional example is computed using a technique 
found in [7]. In this technique, the mapping between joint velocity and virtual model frame velocity 
is directly computed. The Jacobian is then extracted from this mapping. 

Since the multiple legs operate as a parallel mechanism, techniques described in Section 2.6 
applicable and thus used to determine the force distribution among the three supporting legs. 




Figure 3-4: Drawing of hexapod, used in the 3D example, standing on three of its six legs, 
other three legs are not shown for clarity. 



The 



Figure 3-4 shows the hexapod model standing on three legs. Leg 1 is in the middle of one side 
of the body while legs 2 and 3 are in the front and back of the opposite side of the body. The other 
three legs of the hexapod are not shown. Figure 3-5 shows a close up view of one of the legs. There 
is one actuated degree of freedom at the knee and two at the hip. The knee angle is 6k t and the hip 
angles are 6hi t and 9h2,- If the joint angles are all zero, the leg will point straight down from the 
body. Each leg is comprised of an upper and lower link, both of length L. The location of the leg 
with respect to the action frame {B} is (P x , P y , 0). We assume that we can measure only the angles 
of the three joints of each of the three legs. 

We wish to specify a generalized force, B (g F) which acts on the body from the three legs. As 
described in Chapter 2, we must determine the mapping from virtual forces to joint torques and the 
mapping from a generalized force to the individual virtual forces applied by each leg. 

The Jacobian from the reaction frame to the action frame for a given leg, B ( B 'J) is determined 
via an iterative computation of the joint velocity to cartesian velocity mapping, as described in [7]. 
This Jacobian maps the virtual model generalized forces to joint torques for the ith leg, 
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Figure 3-5: Diagram of a single leg of the hexapod example. There is one actuated degree of freedom 
at the knee and two at the hip. The knee angle is 0^ and the hip angles are O^i and 9^2- The leg 
links are both of length L. The location of the leg with respect to frame {B} is (P x , P y , 0). 
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(3.25) 
where c x = cos(6 x ) and s x = sin(6 x ). 

Since no moments can be applied at the point feet each leg has three natural constraints. Fol- 
lowing the method in Section 2.6.1 we have 

(3.26) 
(3.27) 
(3.28) 
(3.29) 
(3.30) 

To reduce the size of the matrix to be inverted, we must partition the individual components of 
the virtual forces into the Minimum Force Set (6 elements), Redundant Force Set (3 elements), and 
Constrained Force Set (9 elements). For our 3 design constraints, we decide to match the horizontal 
forces of legs 2 and 3 and match the lateral force of leg 1 with the sum of the vertical forces of legs 
2 and 3, 
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(3.31) 
(3.32) 
(3.33) 

These design constraints are written in the terms of Equation 2.17 if we partition the virtual 
forces as follows, 



J X 3 


= fx2 


fy3 - 


= fy2 


fyl - 


= 2/j, 2 



MFS = {fxl, fzl, fx2, fy2, fz2, f zz} 
RFS = {f x 3, fy3, fyl} 

CFS = {n xl ,ny 1 ,n zl ,n x2 ,ny2,n Z 2,n X 3,ny3,n z3 } 
The constraint equation (2.12) can now be written in expanded form, 
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The first six rows of the constraint matrix state that the sum of the virtual force and moment 
vectors for each of the individual legs equals the total virtual force and moment vector acting on the 
body at frame {B}. The next three sets of three rows define the natural constraints of zero torque 
at each foot. The last three rows are the design constraints chosen in Equation 3.33. 

The elements of the natural constraints, J la and J lb are extracted from the Jacobian Transpose. 
The Minimum and Redundant Force Sets are acted on by J la where 



-Ls h2; (c k;+hl . +c hl .) Lc h2 .(c k;+hl . +Chi ; ) 

(J la ) = -Lc h2; (l +c k .) -P y; s k;+hl . -Ls h2; (l +c k .) +P x; s k;+hl . 
Lc h2; s k . - P y; c k;+hl . Ls h2; s k . + P x; c k;+hl . 

while the Constrained Force Set is acted on by J lb where 
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_ Pyi S h2; C k i +hl; - Px; C h2; C k;+hl . 

Pyi S h2; S k i +hl; + Px; C h2; S k;+hl . 

(3.35) 





Ski+hli 
-Cki+hli 



(3.36) 



Note that the angles the foot makes with frame {A} do not appear in any of the previous 
equations. In order to derive these equations, X-Y-Z Euler angles were used at the feet. The foot 



c£b 
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angles did not appear in the torque-force relationship 3.25. However, they did appear in the natural 
constraints, J la and J lb . The natural constraint equations define a 3 dimensional subspace of the 6 
dimensional virtual force space. This subspace is the space in which "admissible" virtual forces can 
be applied. We verified that this subspace is the same for any foot angles. Therefore we were able 
to arbitrarily set the foot angles to zero. 

An intuitive explanation for why the foot angles do not matter is that virtual forces are being 
applied from frame {A{} to frame {B} with respect to frame {B}. How we define frame {A} therefore 
doesn't matter, as long as we can specify the foot angles in some way. Therefore, it is arbitrary what 
the foot angles are and we can set them to zero in order to eliminate them from our equations. 

The submatrix, J lb , happens to be orthonormal so that its inverse is simply its transpose, 
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We eliminate the Constrained Force Set from Equation 3.34 using Equations 2.15 and 2.16, 



(3.37) 



Jx 

fy 

fz 

n x 
n y 
n z 







where, 



-lb T la 
1.1 



-lb T la 
2,1 



-lb T la 
3,1 



-lb T la 
1,2 



-lb T la 

2,2 



-lb T la 
3,2 



-lb T la 
1,3 



-lb T la 
2,3 



-lb T la 
J 3,3 



-2b T 2a 
1,1 



-2b T 2a 
2,1 



-2b T 2a 
3,1 



-2b T 2a 
1,2 



-2b T 2a 
2,2 



-2b T 2a 
3,2 



-2b T 2a 
1,3 



-2b T 2a 
2,3 



-2b T 2a 
J 3,3 



-3b T 3a 
1,1 



-3b T 3a 
2,1 



-3b T 3a 
3,1 



-3b T 3a 
1,2 



-3b T 3a 

2,2 



-3b T 3a 
3,2 







1 








fxl 







fyl 


1 




fzl 


3b T 3a 
1,3 




fx2 


3b T 3a 
J 2,3 




fy'2 


3b T 3a 
J 3,3 




fz2 







1x3 







fy3 







_fz3 _ 
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(3.39) 
Equation 3.38 is now rearranged so that it is in the form of Equation 2.18. 
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(3.40) 



Now A m is the upper left 6x6 submatrix, A r is the upper right 6x3 submatrix, B is the lower 
left 3x6 submatrix, and the 3x3 identity matrix is in the lower right corner. 

We can now eliminate the Redundant Force Set as in Equations 2.18 and 2.19, to get 
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where, 
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To solve for the Minimum Force Set, we need to invert the 6x6 matrix in Equation 3.41. This 
inversion is shown in Appendix A. We next use Equation 2.17 to solve for the Redundant Force Set 
in terms of the Minimum Force Set, 
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(3.42) 



Finally Equation 2.15 is used to solve for the Constrained Force Set in terms of the Minimum 
and Redundant Force Sets, 
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(3.43) 

We now have a relatively small set of equations for coordinating three legs of a hexapod robot. To 
implement virtual model control, one needs only to define a generalized force function as described 
in Section 2.5. The above equations can then be used to compute the required joint torques for the 
three legs. 
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Chapter 4 

Virtual Models vs. Local Control 
Techniques 



In this Chapter, we describe a simple example in which virtual model control works but blind 
application of local control techniques, such as inverse kinematics, fail. The example is that of a 
simple 2-D foot which is modelled by three links and two joints. We wish to make the foot perform 
several maneuvers. These include moving to a desired configuration and transitioning from being 
supported by its heel to being only on its toes. 

The mathematics required for implementing virtual components on this robot was described in 
Section 3.3. We attempt to provide an intuitive description of why virtual model control works with 
this example and inverse kinematics fails. Simulations were performed which verified the technique. 



4.1 Intuitive Explanation 

Figure 4-1 shows the foot model in a hypothetical position. The solid figure shows the current 
position of the foot. We wish to control the foot so that it moves towards the desired position, 
indicated by the dashed figure. To do this we can connect a virtual spring between frames {A} 
and {B} which will push the foot toward the desired position. Another option is to use inverse 
kinematics control to servo the individual joints to the corresponding desired angles. 

A virtual spring will produce the force F vm as in the figure. Transformation to joint torques 
will produce a toe torque T t which would seem to cause the toe angle to increase. This is opposite 
to the direction which we desire it to travel! However, the joint will indeed travel against the 
applied torque (decrease in angle), thereby producing negative work. This has been demonstrated 
via simulation which we discuss below. In contrast, inverse kinematic control will produce a toe 
torque which opposes the joint angle error and thus will be opposite in sign of the torque generated 
via virtual model control. This torque will indeed cause the angle error to decrease but instead of 
the foot pushing on the ground it will simply lift its toes. Therefore, the blind application of inverse 
kinematics control will produce undesirable results with this example. 

One can demonstrate the above result by standing on his or her toes and pushing up and down 
while keeping one's knees locked. To go up, one must push harder on his or her toes which results 
in the toe joint rotating against the applied torque. At first it may take some effort to determine 
exactly what is happening. Although the virtual force (push down) and cartesian movement (move 
up) is easily understandable, the actual joint torques and joint motion takes some effort to properly 
observe. This suggests that the joint angles and torques in this task don't even enter ones conscious. 
If so, then coordinate transformations similar to those used in virtual models must occur outside 
ones conscious in order to perform this task. 

One fundamental difference between the two methods is that virtual model control utilizes infor- 
mation from all the joints and is thus a global method. In contrast, inverse kinematics is generally 
a local method. Once the desired joint angles are determined, each joint independently attempts to 
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Ankle 




Toe 

Figure 4-1: Simple foot example showing virtual model forces, Fvm and required toe torque, T t . 



servo to that position. 

It is possible that a non-local variant of inverse kinematics could work with this example. For 
instance, if we examine the error of the virtual angle between the toes and the body and produce 
a toe torque which opposes this error, then the torque will at least have the desired sign. However, 
this would be a global technique, since it would require knowledge of both joint angles and would 
require the use of a virtual sensor (measurement of the angle between the toe joint and the body). 

Another difference between the two methods is that intuition can be easily applied to virtual 
model control while it is not clear how to apply it to local techniques. With our foot example, 
intuition helps us decide where to place the virtual model frames and which components to use. 
Blindly applying a technique such as inverse kinematics doesn't even allow one to exploit the fact 
that the foot is not rigidly attached to the ground. If the foot were attached to the ground, inverse 
kinematics would work. However, it is not clear how to exploit this knowledge to alter the inverse 
kinematic technique for application to our foot example. 



4.2 Foot Simulation 

Simulations were performed to demonstrate that virtual model control can be used to successfully 
control the robot foot example. The following components were used: a virtual spring-damper acting 
in the horizontal (x) direction; a separate virtual spring-damper acting in the vertical (z) direction; 
and a virtual vertical force to help counter gravity. We stress that gravity cancellation was probably 
not necessary but was used so that the virtual vertical spring could have a lower spring constant and 
hence be a "less demanding" virtual component in terms of bandwidth requirements (see Chapter 

6). 

Figure 4-2 shows the results of a particular simulation in which the foot, initially in a "back on 
its heels" position, moved to a desired "up on its toes" position. The actual x and z values (solid) 
are plotted along with the virtual spring set-points (dotted) in the first two graphs. The resultant 
virtual horizontal and vertical forces are shown in the next two graphs. The applied joint torques 
are plotted in the bottom two graphs. On the right is a graphical representation of the foot going 
"up on its toes." 

When the foot is "back on its heel" , we place the virtual model reaction frame at the ankle 
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Figure 4-2: Simple foot example simulation. The top two graphs show the x and z positions of the 
top of the upper link with respect to the toe joint. The middle two graphs show the forces applied 
in the x and z directions due to the virtual components. The bottom two graphs show the resultant 
toe and ankle torques. On the right is a graphical representation of the foot simulation. 
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joint rather than at the toe joint. This is accomplished simply by applying no toe torque, which 
effectively projects the virtual forces unto the line perpendicular to the upper leg link. Once the 
center of pressure passes the toe joint, which is sensed via ground contact interaction, then toe 
torque is applied. We do this because toes are not needed to support the foot if the heel is doing so 
and can therefore remain unactuated. 

This simulation exhibits rather oscillatory behavior. This is because we chose a low virtual 
damper constant. Although the tracking error is relatively low for the x value, we are not interested 
in tracking error here. We are more interested that the simulation works and that it behaves as 
though the virtual components were actually connected to the foot. This simulation demonstrates 
that a few simple virtual components can be used to perform a somewhat complex task that a 
non-global controller such as blind application of inverse kinematics can not perform. 
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Chapter 5 

Developing Lyapunov Functions 
for the Stability Analysis of 
Virtual Model Controllers 



There are two powerful methods for deriving Lyapunov functions for a given virtual component. 
The first method draws from physical intuition and results in energy-based Lyapunov functions. 
The second method involves designing the component so that it forces a certain Lyapunov function 
to decrease. Both methods have their own niche and neither allows for the analysis of an arbitrary 
virtual component. Therefore, it is best to keep Lyapunov stability analysis in mind while designing 
virtual components rather than apply it after the components are designed. We briefly describe both 
methods below and in section 5.3 we use energy-based Lyapunov Functions to demonstrate that a 
passive robot controlled with any number of passive virtual spring-damper mechanisms remains 
passive. 



5.1 Energy Based Lyapunov Functions 

If physically realizable virtual components are implemented, a good candidate for a Lyapunov func- 
tion is the virtual energy stored in the components. For example, if virtual mass-spring-damper 
mechanisms are used, the Lyapunov function can contain the kinetic energy of the mass plus the 
potential energy of the spring. If several such virtual components are used, one can simply sum these 
virtual energies with the kinetic energy of the robot itself (^0 T HO in the case of a serial robot). 
The derivative of the Lyapunov function will then be the power dissipation of the virtual dampers. 
This is demonstrated in 5.3. 



5.2 Design Based Lyapunov Functions 

A second method for deriving Lyapunov functions is to develop a control law such that a given 
Lyapunov function decreases. Such an approach is used in sliding controllers and adaptive controllers. 
It is probably possible to use such techniques to develop "virtual adaptive controllers" . This is not 
explored in this thesis however. Learning virtual components have been implemented previously 
using CMAC neural networks [22] but no Lyapunov analysis was performed. 
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5.3 Demonstration of Energy Based Lyapunov Functions 
for Virtual Spring-Damper Mechanisms 



Energy methods can be used to develop Lyapunov function candidates for virtual mechanisms applied 
to a robot. Below we demonstrate, using Lyapunov analysis, that a passive robot, with passive 
spring-damper mechanisms connected to it, remains passive. In the analysis, we assume that the 
virtual components are perfectly implemented. Intuitively, if we had a passive robot with real 
versions of the passive components attached to it, then the system would remain passive. 
The dynamic equation of a robot arm can be written 

H(&)e + c(e,e)e + g(&) = T (5.1) 

where H is the inertia matrix, C contains gyroscopic and coriolis terms, g contains gravity terms, 
and r is the joint torques. Assume that the arm is operating in the horizontal plane so that g(Q) = 0. 
Suppose we have a virtual component with action frame {B}, reaction frame {A}, and reference 
frame {0} and the following force function 

^F) = -k 1 ( (*X))-b 1 (°(*X)) (5.2) 

were °(4.A) is the stretch of the virtual spring, °(4.X) is the velocity of the virtual damper, k\ 
is the virtual spring function, and b\ is the virtual damper function. Neither the spring, nor the 
damper is assumed linear. We use °(gX) for the argument to the virtual damper equation in this 
case because the damper is connected between frames {A} and {B} and not connected to the spring 

set point. If it were, we would use °(gX). However, in this analysis, the spring set point isn't 

changing and hence °(gX) =° (gX). Assume that the spring is passive, which implies that 

X T fci(A) >0 VI (5.3) 

and that the damper is dissipative, which implies that 

X T &i(A) >0 VI (5.4) 

A good choice of Lyapunov function is the energy in the virtual spring 



O /A - 



( X) 

V= I B h(X)6X (5.5) 



/o 
We now add this to the robot energy to get 



1 



V=^-0 T HO+ k 1 (X)8X (5.6) 

* Jo 

V will be positive definite and radially unbounded if the passive spring condition (Equation 5.3) 
holds. Taking the derivative we get, 

v = q t hq + 1 -q t hq + h^dxyfdx) 

Expanding HQ using equation 5.1, using the fact that H — 2C is skew symmetric, and X = X, this 
becomes 

v = e T ( (P) T0 (iF)) + k 1 (°(ix)f(ix) 

Taking the transpose of Equation 2.3 we get 

e T °(P) T =° ( A B xf 
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Using this equation, and substituting in the virtual component force function, we get 

v =° (ixn-k^dxj) - hcax))) + k^axjfdx) 

which becomes 

V = -°( A B X) T b l (°( A B X)) (5.7) 

V will be negative definite as long as the assumption of equation 5.4 holds. 

Notice that this demonstration says nothing about where the virtual components are attached 
nor makes any assumptions about linearity. Thus this analysis holds for all passive virtual spring- 
damper mechanisms connected to a robot arm with no gravity present. If gravity is present, one can 
add virtual vertical forces at the center of mass of each link to compensate for it. This is equivalent 
to adding g(Q) to the applied torque vector. Our analysis then reduces to the present one and all 
results hold. 

Because energy is a scalar, and hence adds, if we attach a number of virtual spring-dampers to 
the robot with action, reaction, and reference frames {5 8 }, {A} and {0 8 } and virtual spring and 
damper functions k{ and &;, we can use the Lyapunov function and derivative 

°'( A 'X) 

V =ie T J ff6 + V / B * ki(X)hX (5.8) 

^ = -E 0, (*: x ) T M°-(^)) (5.9) 

i 

Thus we have shown that a passive robot arm remains passive when any number of passive 
virtual spring-damper mechanisms are attached to it. 
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Chapter 6 

Virtual Model Limitations Due to 
Non-Ideal Actuators 



The implementation and analysis of virtual components to this point has assumed that the desired 
joint torques required to implement the virtual component could be directly applied, i.e. that 
perfect torque sources existed at the joints. Actuator limitations can severely affect the stability 
and performance of a virtual model controller. In this chapter, we attempt to quantify the actuator 
limitations and determine where they come into play. I use series elastic actuator techniques [34] 
in this analysis since it is the actuator method used on our bipedal walking robot. The concepts 
presented below hold for any actuation technique however. 

6.1 Virtual Actuator Saturation 

If we ignore dynamic forces, we can solve for F max in the following static equation to compute the 
steady-state virtual actuator saturation limits, 

T max = (b^J \B^rnax) (.0-1) 

To solve Equation 6.1, one must take the inverse of the Jacobian transpose. Near singularities large 
virtual forces can be exerted with small motions. This takes place, for example, with an almost 
straight knee. Away from singularities (large knee bend, for example), the maximum allowed virtual 
forces may be much smaller. Equation 6.1 gives us the static limitations of the virtual components. 
The next section discusses dynamic limitations. 

6.2 Series Elastic Actuators 

Robot force control has proven to be a difficult endeavor due mainly to actuator limitations. Since 
most actuator technologies deliver high speed and low torque, speed reduction has to take place in 
order to generate high torques at low speeds which is desirable in most robotic applications. Various 
methods of speed reduction exist, but the most common method involves gear trains. Geared 
transmissions suffer from friction, backlash, and non-collocation, all which are undesirable effects. 
Therefore, the most successful force controlled robots have used large pulleys for reduction and 
cable transmissions, thereby eliminating gears [27]. The drawbacks of this technique are the space 
requirements of the large pulleys and the need for low friction motors. 

Series Elastic Actuation is a technique which allows one to perform force control with non-ideal 
actuators and transmissions. An elastic element (represented by k s in Figure 6-1) is intentionally 
placed between the motor mass and the load. Since the force on the load is a function of the 
spring stretch, the force control problem effectively reduces to position control of the motor end of 
the spring [34, 21]. Although we examine Series Elastic Actuation limitations here, the following 
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Figure 6-1: Series elastic actuator model. Mm is the motor mass. Ks and Bs are the spring constant 
and damping constant. Kc(s) is the compensator. Fd is the desired force while Fl is the actual force 
applied to the load. Xm and XI are the motor and load displacements. 



analysis will hold for any non-ideal torque control scheme, 
control of our bipedal robot (see Chapter 9). 



We use Series Elastic Actuation in the 



6.3 System Block Diagram 



Figure 6-2 shows two system block diagrams. Figure 6-2 a) is the desired system, achievable if we 
had perfect actuators while Figure 6-2 b) is the entire system, including non-ideal actuators. VM 
represents the virtual model, an impedance which takes as input the generalized positions of the 
robot, Or and produces joint torques t<j. R is the robot itself, an admittance which takes in joint 
torques, tr and outputs it's joint positions, Or. G represents the actuator transfer function matrix 
from desired torque to actual torque and Z represents the actuator impedance matrix. 

Using series elastic actuation with linear elements and implementing a PD compensator, K c (s), 
we get the following actuator transfer function matrices 



G(s) = 2C >riU n s + uj'j l 



(6.2) 



Z{s) 



s 2 + 2( n ui n s + uil 



-I 



(6.3) 



Bode diagrams of these transfer functions for the SISO case are shown in Figure 6-3 for k s = 10.0, 
C n = 0.7071, u> n = 30.0. Ideally we want G(s) = 1 and Z(s) = 0. From the bode diagrams, we see 
that this is a good approximation at low frequencies, but above the actuator bandwidth frequency, 
G(s) — ► at —20 dB/dec and Z(s) approaches the impedance of the spring, — k s . This is because at 
high frequencies, the motor mass cannot be accelerated quickly enough and to the load, the system 
appears as the spring connected to ground. 



6.4 Discussion 

The bandwidth limitations of G(s) are typical of any force control actuation scheme. The impedance 
transfer function Z(s) is also typical except that with Series Elastic Actuation, the impedance at 
high frequencies is relatively low due to the elastic element. For this reason, Series Elastic Actuation 
successfully handles shock loads. 

Due to the bandwidth limitations of the actuators, the implementable virtual components are 
limited. Intuitively, we can only use "low frequency" virtual components. In order to quantify this 
better, we must develop a method to analyze the effects of the non-ideal actuators. Several issues 
to consider are 
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Figure 6-2: Block diagrams of a) Virtual Model (VM) and Robot (R) with perfect torque controllers 
and b) with non-ideal controllers. G is the torque controller transfer function matrix and Z is the 
torque controller impedance matrix. 
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a) G(s) Bode Magnitude Plot 
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b) Z(s) Bode Magnitude Plot 
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Figure 6-3: Typical bode diagrams of G(s) and Z(s) for Series Elastic Actuation. Ideally G(s) = 1 
(0 db Gain, deg Phase) and Z(s) = (- oo Gain, deg Phase). This is a good approximation at 
low frequencies but poor at high frequencies. At high frequencies G(s) « and Z(s) « K s . 
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• Stability of the virtual model and robot with ideal actuators (Figure 6-2, (a)) 

• Stability of the complete system including the non-ideal actuators (Figure 6-2, (b)) 

• Deviation of the complete system from the desired system 

• Design of the virtual model controller such that the result of it and the non-ideal actuators 
better represents the desired virtual model. 

Chapter 5 discussed Lyapunov methods to address the first issue. Tools to explore the second 
and third issues are discussed in Chapter 7. 

We conjecture that the fourth issue is moot. We believe that it is not beneficial to attempt to 
modify the virtual model implementation, in light of the actuator limitations, so that the resultant 
effect is closer to that desired. At low frequencies, the actuators exhibit desirable behavior and hence 
there is no reason to attempt compensation. At high frequencies, the actuator performance is poor. 
However, the reasons for which the performance is poor are the same reasons which prevent successful 
compensation. These reasons include sampling rate, unmodelled dynamics, actuator saturation, 
etc. Therefore, given an actuator plant and force controller which are already tuned (G and Z of 
Figure 6-2 are fixed), we conjecture that no performance increases can be achieved by modifying the 
virtual model implementation. Therefore, one should take into account actuator and force controller 
limitations when choosing virtual components but assume perfect actuators when implementing 
them. 
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Chapter 7 

Stability and Performance 
Analysis 



In this chapter we examine stability and performance issues in implementing virtual model con- 
trollers. In doing so, we first define what we mean by these terms and then examine the available 
tools for analyzing stability and performance properties. 

7.1 Stability 

In Chapter 5 we discussed methods for constructing Lyapunov functions to show that a robot 
controlled with a particular virtual model controller is stable. This analysis, however, assumed 
perfect actuators. We require a method which will determine stability when non-ideal actuators are 
used assuming the system is stable when perfect actuators are used. Unfortunately, it is not clear 
how to construct Lyapunov functions for the case with non-ideal actuators. Hence, the non-linear 
case is not considered here. We hope that by considering the linear case, we can gain insight into 
the issues. 

Figure 7-1 shows that the error due to non-ideal actuators can be expressed as a multiplicative 
error, E. If the actuator diagram of Figure 6-2 is used, we get 

E(s) = [-G(s) + I] + Z(s)VM(s)- 1 (7.1) 

The virtual model and robot can then be lumped into T(s), 

T(s) = -VM(s)R(s)[I + VM(s)R(s)]- 1 (7.2) 

We can now invoke the Small Gain Theorem which states that the system in Figure 7-1 b) is stable 
if T(s) is stable and 

(Tmax[T{jw)] < — - Vw (7.3) 

<rmax[E(jW)\ 

This is a sufficient, but not necessary condition and hence is conservative. It is very useful, however, 
since one only needs an upper bound on T ma x[E(jw)] and doesn't need to know E(s) exactly. 

7.2 Performance 

As stated in Chapter 1, it is often very difficult to express a performance requirement for an in- 
teractive robot. In this light, we instead define the performance of the virtual model controller as 
how well it implements the desired virtual model while using non-ideal actuators. This is similar 
to the analysis in [6]. In other words, we wish to quantify how much VM' in Figure 7-2 will differ 
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Figure 7- 1 : a) Virtual model error expressed as a multiplicative error (E) . b) VM and R are combined 
into T for the linear case so that the Small Gain Theorem can be employed. 
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Figure 7-2: Actual virtual model implemented (VM') will differ from desired virtual model (VM). 



from VM in Figure 6-2 a) or how much CL' in Figure 7-3 will differ from the desired closed loop 
response. 

We can calculate the actual virtual model, VM' , the desired closed loop response, CL, and the 
actual closed loop response as 



VM'(s) = G{s)VM(s) - Z(s) 



(7.4) 



CL{s) = R(s)[I + #(s)FM(s)] -1 



(7.5) 



CL'(s) = R(s)[I + R^VM'is)]- 1 



(7.6) 



We can now define two performance specifications, namely that the maximum and minimum singular 
values of the actual virtual model are within the spread, &vm, of those of the desired virtual model, 

Abs[(T max [V M(jw)] - (Tmax[VM'(jw)]] < 8 VM V U) < U) h 
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Figure 7-3: Robot (R) and virtual model controller (VM') as seen by the environment (ENV). In b) 
CL' is the closed loop admittance of the system as seen by the environment. 



Abs[a min [VM(jw)} 



l [VM'{jw)]]<6 VM Vw<w 6 



and that the maximum and minimum singular values of the actual closed loop system are within 
&CL of those of the desired closed loop system, 

Abs[<J max [CL{iw)] - (Tmax[CL'(jw)]\ < 8 C L Vu<Wj 

Abs[a min [CL(jw)] - a min [CL'(jw)]\ < 8 C l V us < u> h 
where wj is the break frequency below which we desire good performance. 

7.3 Robustness 

Finally, we may wish to analyze how the robot with virtual model controller will behave in the 
presence of environmental disturbances as depicted in figure 7-3. To this end, we can utilize pas- 
sivity theory which states that a passive robot will be stable when in interaction with any passive 
environment [6]. The closed loop system will be passive if 



jwCL'(jw) + jwCL' 1 (-jw) > V w > 



(7.7) 



We add the jw terms since CL' is defined as —^- while passivity requires it to be in the form — ^. 
For a single input - single output (SISO) system, equation 7.7 reduces to 



0° < phase[CL'(jw)] < 180° V w > 



(7.8) 



Note that if Equation 7.7 holds, the closed loop system will be stable when in contact with any 
passive environment. If we know that the environment will be compliant and damped to a minimum 
extent, then we can relax this requirement to CL' being passive below the "roll-off frequency" , w env , 
of the environment [4], i.e. 



jwCL'(jw) + jwCL' (-jw) > V u> < w env 



(7.9) 



7.4 Discussion 

This section has presented stability and performance requirements for linear robots controlled with 
linear virtual model controllers. It is not clear how to perform such analysis with non-linear systems. 
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We hope that by examining a few linear systems we may gain insight into the relevant issues. In 
Chapter 8 we present a simple SISO LTI example. 
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Chapter 8 

Example of a Simple SISO, LTI 
Plant and Virtual Model 
Controller 



In this chapter we examine a simple SISO LTI plant with a linear spring-damper virtual model 
controller. Although this is far from the non-linear MIMO case which we wish to analyze, it should 
still give insight into the relative control issues and may possibly provide some design guidelines. 

In this example, the plant is simply a point mass robot with mass of M r and the virtual model is 
a spring-damper mechanism with spring constant k v and damping constant b v . The desired virtual 
model, VM , and the robot, R, of Figure 6-2 are then, 

VM(s) = b v s + k v (8.1) 



^ = W7 2 ^ 



The desired closed loop system is thus 



CL(s) = R(S) = 1 = I (8 3) 

W l + R(s)VM(s) M r s 2 + b v s + k v M r (s 2 + 2C, v w v s + w 2 ) y ' J 

where ( v and w v are used to represent the desired damping ratio and natural frequency. 

Using Series Elastic Actuators, as in Chapter 6, we have the following force Transfer Function 
and impedance Transfer Function 

= 2Cw + ^ 
v ' s 2 + 2C„w n s + W 2 v > 

Z( s ) = Z^lf! ( 8 .5) 

The apparent impedance to the robot is 

VM'(s) = -Z(s) + G(s)VM(s) (8.6) 

_ (-k, + M r (2C n w n )(2C v w v ))s 2 + M r (2( v w v w 2 n + 2( n w n w 2 v )s + M r w 2 v w 2 n 

s 2 + 2( n w n s + w 2 n 

resulting in a multiplicative error 

E(s) = s 2 (M r (2C v w v +w 2 v )-k s ) 

{ ' (s 2 + 2( n w n s + w 2 n )M r (2( v w v + w 2 ) { ' ' 



>Li 
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The transfer function used in invoking the small gain theorem, T(s) in Figure 7-1, will then be 

{ ' M r ( S i+2( v w v s + wi) { ■ ' 

and the actual closed loop system, 

S 2 + 2CnW n S + W 2 



CL'(s) 



M r s 4 + 2CnW n M r S 3 + (-k s + M r ((2CnW n )(2CvW v ) + wg))s 2 + M r (2CvW v wg + 2CnW n W?)s + M r w?wg 

(8-9) 
The denominator of CL'(s) is the characteristic polynomial of the entire system and its roots 
are the closed loop poles. In Figures 8-1 to 8-3 we show bode diagrams for these transfer functions, 
closed loop impulse response, and pole-zero diagrams of the desired and actual closed loop system 
for three different values of w v . In Figure 8-4 we show the locus of closed loop poles of the system 
as we vary w v from 1.0 to 60.0, with 

k s = 10.0 

w n = 30.0 
Cn = 0.7071 

M r = 10.0 

Cv = 0.7071 



8.1 Results 

In Figure 8-1, we use a value of w v which is i that of w n . In other words, the bandwidth of the 
force controller is much higher than the bandwidth of the robot with virtual controller. Because of 

this, <Tmax[T(s)] is well below )e( s ) ] thereby guaranteeing stability by the small gain theorem 

(Equation 7.3). We see that the bode magnitude plot of VM'(s) resembles that of VM(s) up to 
about 30.0 rad/sec and CL'(s) and CL(s) are similar over all frequencies. The actual and desired 
impulse response are nearly identical and the pole-zero diagram shows that the desired poles are 
placed well, while the extra poles due to the actuator dynamics are faster and nearly cancelled by 
near-by zeros. We see that ph&se[C L' (jw)] stays between 0° and 180°, thereby guaranteeing stability 
when in contact with any passive environment by Equation 7.8. 

In Figure 8-2, we use a value of w v which is ^ that of w n . Stability margins begin to decrease 
and performance begins to degrade but may still be acceptable. Ph&se[C L' (jw)] still stays below 
180°. 

In Figure 8-3, we use a value of w v which is | that of w n . The system is still stable but 
performance is unacceptable. The actuator dynamics are more pronounced than the virtual model 
dynamics. Also, Ph&se[C L' (jw)] begins to go beyond 180°. Therefore the system will not be stable 
for contact with all passive environments. 

From Figure 8-4 we see that the actual closed loop poles match the desired ones for low w v but 
start to diverge at higher w v . The poles due to the actuator dynamics are fast and less significant 
for low w v but move toward the jw axis as w v is increased, dominating the system dynamics for 
w v > 25-^, and finally cross into the right hand plane, making the system unstable. 



8.2 Discussion 

From this simple example we see that even though the nominal system may be stable, as soon as 
actuator dynamics are considered, stability and performance may be compromised if the virtual 
model and robot have components at high frequencies compared to the actuator bandwidth. This 
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Figure 8-1: Simple SISO example with u> v = 5.0 
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Figure 8-2: Simple SISO example with u> v = 10.0 
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Figure 8-3: Simple SISO example with u> v = 25.0 
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Figure 8-4: Locus of closed loop poles as u> v is increased from 1 to 60. At low u> v , the poles due 
to desired dynamics dominate. At high u> v , the poles due to the actuator dynamics dominate and 
eventually enter the right half plane. 
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analysis holds for any non-ideal actuator scheme. We used Series Elastic Actuators here because it 
is the method we use for our bipedal walking robot. 

For more complex systems, it may be difficult to perform such an analysis. However, we can con- 
clude from this example that a higher bandwidth force controller will allow more accurate emulation 
of virtual components. 
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Chapter 9 

Bipedal Walking Robot 




Figure 9-1: Photograph of Spring Turkey, our bipedal walking robot. There are four actuators 
attached to the body. Power is transmitted to the hips and knees via cables. The unactuated feet 
consist of a strip of rubber. A boom is used to prevent motion in the lateral, roll, and yaw directions. 
Note the spring packs which are used to implement series elastic actuation. 



Two applications of virtual model control have been applied to Spring Turkey, our bipedal 
walking robot. The first application is deep knee bends which verifies the use of multi-frame virtual 
components for parallel mechanisms. The second application is simple walking. In both applications 
only a simple set of virtual components is used. 
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9.1 Spring Turkey 

Figure 9-1 is a photograph of Spring Turkey, our bipedal walking robot. Spring Turkey was de- 
signed and built by Peter Dilworth in 1994. It has an actuated hip and knee on each leg. An 
unactuated boom constrains Spring Turkey's roll, yaw, and lateral motion thereby reducing it to 
a two dimensional robot. All of Spring Turkey's motors are located in its upper body, with power 
being transmitted to the joints via cable drives. Series Elastic Actuation [21] is employed at each 
degree of freedom, allowing for accurate application of torques and a high degree of shock tolerance. 
The maximum torque that can be applied to the hips is approximately 12 Nm while approximately 
18 Nm can be applied to the knees. The force control bandwidth we achieve is approximately 20 
Hz. Spring Turkey weighs in at approximately 22 lbs (10 kg) and stands 2 ft (60 cm) tall. 

Rotary potentiometers at the hips, knees, and boom measure joint angles and body pitch. Linear 
springs are used at the hips and knees to implement Series Elastic Actuation. Rotary potentiometers 
measure hip spring stretch while linear potentiometers measure knee spring stretch. 

9.2 Deep Knee Bends 

Virtual model control was applied to Spring Turkey to make it perform deep knee bends using a 
very simple set of virtual components. A virtual spring-damper mechanism was simulated in the 
vertical direction. The rest position of the spring was modulated in a sinusoidal fashion to cause the 
body to move up and down. A virtual force source was applied in parallel with the vertical spring 
to help counter gravity. A separate virtual spring-damper mechanism was applied in the horizontal 
direction to regulate the body position to be midway between the two feet. A torsional virtual 
spring-damper mechanism was applied to regulate the body pitch to zero. 

Figure 9-2 shows experimental data from Spring Turkey while performing deep knee bends. The 
top three graphs show the body's horizontal position (x), vertical position (z), and pitch (theta), 
and the corresponding spring set points (dotted). The next three graphs show the virtual forces 
applied to the body due to the virtual components. The resultant torques which are applied to each 
of the joints are plotted in the bottom graphs along with the position of the joints. 

We have demonstrated that deep knee bends can be performed using only a simple set of virtual 
components. Although this might not be the "best" algorithm for implementing knee bends, it 
is easy to implement and hence a good start. The main issue is that the robot behaves as if the 
virtual components are really connected to the robot. We are less interested in "performance" in 
the traditional sense. 



9.3 Stupid Walking 

Virtual model control was applied to Spring Turkey to make it perform simple walking. We 
attempted to develop the simplest possible algorithm which would successfully allow Spring Turkey 
to take several steps before stopping or falling down. Simply stated the algorithm is as follows: 

• Maintain a constant height and pitch. 

• Transition from double support to single support if the body's x position becomes close to that 
of a foot. 

• Transition from single support to double support if the body's x position becomes far away 
from the support foot. 

• Servo the swing leg so that the foot is placed the nominal stride length away from the support 
foot when transitioning to double support. 

• During double support, push in the direction of desired travel with a constant virtual force. 
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Figure 9-2: Knee bends experimental data. The top row of graphs show Spring Turkey's position 
and the virtual spring set points. The second row shows the virtual forces applied due to the virtual 
components. The bottom left column of graphs show the resultant torques applied to the joints 
while the bottom right column shows the position of the joints. 
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Figure 9-3: Spring Turkey with virtual components during single support phase. We use a virtual 
vertical spring-damper, a virtual vertical force source, and a torsional spring-damper connected 
between the body and support foot to maintain balance and height. The * indicates that these 



components are connected to the support foot, 
swing leg for foot placement. 



We use virtual spring-damper mechanisms on the 



Because of the simplicity of this algorithm and the lack of any speed control or robustness 
mechanism, we dub it "Stupid Walking". We are not interested in the specific aspects of the 
algorithm here. Rather, we are interested in examining the effort required to implement it using 
virtual components and a simple state machine. We only hoped to achieve a few consecutive steps 
with this algorithm. Future work will concentrate on developing more robust algorithms. 

To implement Stupid Walking, we use a simple set of virtual components. Figure 9-4 shows the 
state machine used for the Stupid Walking algorithm. Table 9.1 lists the trigger and branch events 
and the virtual components which are utilized in each state. During both double support and single 
support, a virtual spring-damper mechanism in the vertical (z) direction with a constant set point 
maintains a constant height. A virtual vertical force is applied to help counter gravity. Also, during 
both double and single support a virtual torsional spring-damper mechanism regulates the pitch 
angle to zero. During double support, we apply a constant virtual force in the forward horizontal (x) 
direction to help push Spring Turkey in the desired direction of travel. The swing leg is controlled via 
a local virtual spring-damper mechanism at each individual joint, thereby implementing an inverse 
kinematic algorithm. The set point of these springs are modulated so that the foot of the swing leg 
stays a given height off the ground during the swing phase and sets down at the nominal stride length 
distance when transitioning to double support. States LEFT_SUPP0RT2 and RIGHT_SUPP0RT2 
are used as buffer states between single and double support. Because Spring Turkey has no foot 
switches, in these states the swing leg is simply made limp (zero torque applied to the joints) for a 
set delay time, allowing for the swing leg to fall to the ground before the large forces which double 
support require are applied. 

The various virtual spring, damper, and force variables and walking parameters were chosen using 
physical insight and a manual search. The virtual vertical force matched the weight of the robot; 
the various virtual spring-damper constants were experimentally varied while physically examining 
their effects (resistance to being pushed on, decay rate, etc.) until the desired effects were achieved; 
the walking parameters and virtual horizontal force were changed through trial and error until 
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Figure 9-4: State machine used in the Stupid Walking algorithm. 



Table 9.1: Details of Stupid Walking state machine. 



State 


Trigger Event 


Virtual Components 


1 Double Support 


Delay after 


Vertical Spring-Damper 




left or right 


Vertical Force 




support2 


Torsional Spring-Damper 
Horizontal Force 


2 Left Support 


Body nearly 


Vertical Spring-Damper 




over left foot. 


Vertical Force 

Torsional Spring-Damper 

Local Spring-Dampers on Right Leg 


3 Left Support2 


Body away 


Vertical Spring-Damper 




from left foot. 


Vertical Force 
Torsional Spring-Damper 


4 Right Support 


Body nearly 


Vertical Spring-Damper 




over right foot. 


Vertical Force 

Torsional Spring-Damper 

Local Spring-Dampers on Left Leg 


5 Right Support2 


Body away 


Vertical Spring-Damper 




from right foot. 


Vertical Force 
Torsional Spring-Damper 
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the robot successfully walked. These walking parameters consisted of nominal stride length and 
percent of stride length spent in single support. Because of the lack of speed control or robustness 
mechanisms in the Stupid Walking algorithm, an experimental search through the space of walking 
parameters had to be performed whenever the slightest mechanical changes were made to the robot 
or environment. 

Walking was initiated in the single support phase. A slight push was applied to the robot to 
propel it forward. After the push, no external intervention occured. 

Figure 9-6 shows experimental data from Spring Turkey while performing Stupid Walking. The 
top three graphs show the body's horizontal position (x), vertical position (z), and pitch (theta), 
and the corresponding spring set points (dotted). The next three graphs show the virtual forces 
applied to the body due to the virtual components. The resultant torques which are applied to each 
of the joints are plotted in the bottom graphs along with the position of the joints. The set points 
(dotted) of the springs used for the swing leg are plotted with the joint positions (solid). The state 
of the state machine is plotted in the middle graph. 

The data in Figure 9-6 is plotted in graphical form in Figure 9-5 and also on the bottom of this 
document. The snapshots in Figure 9-5 are approximately 0.5 seconds apart. Lines are drawn to 
show the path of the tips of the feet and the center of the body. The graphics on the bottom of this 
document are spaced approximately 0.18 seconds apart. By flipping through the document, one can 
see an animation of the walking data of Figure 9-6. 




Figure 9-5: Elapsed time snapshot of the bipedal walking data in Figure 9-6. The drawings of the 
robot are spaced approximately 0.5 seconds apart. The left leg is dotted while the right leg is solid. 
Lines show the path of the tips of the foot and the center of the body. 



Spring Turkey walked approximately 3 meters in 5 seconds for an average speed of approximately 
0.6 m/s (1.35 mph). It took 8 steps (left to right or right to left support transitions), giving a step 
time of 0.6 seconds. It deviated a maximum of 4 cm from the nominal height of 52 cm and pitch 
was confined to ±0.15 radians (±8.6 deg). The hip actuators and torque controllers performed well 
while the knee actuators occasionally became saturated. Swing leg tracking was rather poor since 
the virtual spring constants were kept low. 

9.4 Discussion 

Spring Turkey performed deep knee bends and walked eight steps using a simple set of virtual 
components. We stress here that we augmented the natural dynamics of the robot with passive 
virtual components, rather than attempted to cancel the natural dynamics. In no case did we 
assume linear dynamics. 

In both knee bends and walking, the state trajectory converges to a stable limit cycle for an 
appropriate choice of initial conditions. However, the knee bends experiment was more robust in 
response to variations in initial conditions and disturbances than walking. The stupid walking 
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Figure 9-6: Spring Turkey walking data generated using virtual model control. The first row of 
graphs display the x, z, and 9 positions and virtual spring set points, indicated with the dashed 
lines. The second row of graphs display the resultant forces applied to the body due to the virtual 
components. The graph in the third row shows the steady, periodic nature of the state machine. 
The bottom left column of graphs show the resultant desired and actual torques applied to the 
joints. The bottom right column of graphs display the position of the joints and the spring set point 
positions when the given leg is in the swing phase. 
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algorithm contains no speed control or robustness mechanisms and therefore is extremely dependent 
on initial conditions, ground conditions, etc. We have not attempted to perform an analysis on why 
the stupid walking algorithm converges to a limit cycle for the appropriate initial conditions. We 
only speculate that mechanisms similar to those present in McGeer's passive dynamic walker [17] 
are in force. 

In order to perform more robust walking, a speed control mechanism is necessary. This could 
be accomplished either through foot placement during single support or through modulating the 
virtual feed-forward horizontal (x) force during double support. Future work will focus on using 
virtual model controllers to implement walking algorithms which others have found successful and 
on developing new algorithms. 
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Chapter 10 

Conclusions 

We can draw the following conclusions from this project, 

1. Implementation of virtual model controllers is relatively straightforward and computationally 
efficient. 

2. Virtual model control may be successful in some instances in which blind application of a local 
control technique, such as inverse kinematics, fails. 

3. A passive robot, controlled with any combination of passive virtual components, will remain 
passive, assuming perfect actuators. 

4. A number of tools exist for analyzing the stability and performance of linear virtual model 
controllers, connected to linear plants, utilizing non-ideal actuators. 

5. It is not clear how to analyze stability and performance of a non-linear robot, connected with 
non-linear virtual components, while utilizing non-ideal actuators. 

6. The higher the bandwidth of the actuator controllers, the more likely a stable virtual model 
controller will remain stable and the more likely it will implement the desired virtual model. 

7. Simple bipedal walking can be achieved by utilizing a simple set of virtual components. 

The ease of implementing virtual model controllers is promising. One of the major incentives of 
developing virtual model controllers is to make designing robot control algorithms easier and more 
intuitive. The algorithm designer will be given additional incentive to use virtual model controllers 
since they require minimal computational resources and are straightforward to derive. One of our 
goals is to automate this process. 

The lack of non-linear analysis tools for the non-ideal actuator case is disappointing but was 
expected. One can only use the general guidelines that analysis of the linear case provides, including 
the rule of thumb that the higher the bandwidth of the actuator controller, the better and if the 
bandwidth is limited, one must use "less demanding" virtual components. 

It is quite promising that simple bipedal walking was easy to achieve using simple virtual com- 
ponents. We are hopeful that virtual model control will be useful in producing more robust walking. 
Future work will focus on developing such algorithms. 
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Appendix A 

Matrix Inversion for 3D Example 



To solve for the Minimum Force Set for the 3D hexapod example, we must invert the matrix in 
Equation 3.41, 

fxl 
fzl 
fx2 
fy'2 
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Jx 
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n y 
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We then can solve the Minimum Force Set in terms of the generalized virtual forces, 
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where. 
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